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A Model for Grading Bar 
Examination Essay Questions 

by jean C CaskiU 



Anumbcc of articles ap pearing InTbt Bar 
Bctfmiwrhavc cUsOJssed chc relative merit* 
of ^aaalyocal* vcreu* the *T»olistic M 
methods ofgr-dwg bar waminacion essay 
questions 1 The former method utilize* a checklist ap- 
proach in which tfcc gtadeis assign a certain wej#» to 
each of the issues the exaauaet* are expected to cow, 
scour rhf answer for the presence o* absence of those 
issues, add up chc poincs and assign a grade depending 
upon chc cumulative poin» awarded The holistic 
method, on the other hand, utilizes a less particularized 
aflTroack looking to die ov^all cwu«mi and cpjity uf 
the answer. 2 

Research has shown that die analytical and hoKsric 
methods ate equally ndiablc* Both methods require the 
grtdea to be dSotouglily conversant *id» die i*»u*s die 
author intended to coTef and hour the author wanted 
them cesolved. Both methods measure the examinee's 
ability co recognize and deal with the issues raised in the 
qutaliuiw and Loth nw=d:od& inherently comptft bov wrll 
one caanuncc did relative to other*. 

Neither method can daira scientific precision. Gred- 
ets ucOaing either method will still differ on how well 
examinees dt=dt w>th a particular issue; e,g„ whether, 
although an exumnec rccognixed chc issue he or she 
covered U well enough to receive full or partial credit. 

Th* difference is chat the hdisdc method i* *ig- 
nificandy filter than the analytic method- It is often 
possible to do wo hoEsrie racing* in the time it takes to 
do one analytic rating* If graders can *ave time grading 

fD The K*% ExaMinm. Februaby 1996 



cxauuiudom whliuut^^iiflcLnij cun>t*tenxy **** 
ity, there is no reason not to use the holistic wethad. It 
requites a mind-set shift and some training, but experi- 
ence has shown that, once, the pwiers become coc ifort- 
ablc with a. they pr^'it. and it produce* the wane 
sconng results as the more tedious analytical nu*h >d. 

WhacrbUo^tspdesciipdonofamodd^gJ^^ 
cs«y questions bolucically. It is a variation of thelrxghly 
successful method used ac the srmi-annual gi ading 
shop? attended by the geadcxs from jurisdiction 
admiriater the NCBE's MulcisDte £*«y Examu anon 
arid chc method that will in all probability be used *r the 
grading workshop* fcr the upcoming Multistat* 
fonnanca Test. It is adaptable en almost any essay p 
medium. 



Preparation , , 

As has frequently been said about most sue* tfstul 
v«wun=a in life, there are direr essential prerequisite*: 
preparation, preparation and preparation It is no I 
n»c when it comes co grading essay exammanojvs- 



Tbc Wrirtcn Naxtarivc Analyai* 
The goal of any grading procedure is, of couise, to 
achieve fineness and consistency among du= grad* 
sjgned, and, in order to ensure these qualities, 
impeouvc that Ac graders be thoroughly ftmuiaj 
die question. 

Before » particular question to e*en adopted 



071 tfae bar examination, the author should ha c re- 



m 



m 



the< 



it is 
with 



p >r use 
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arched ihciisoeg carefully ajul written a uaaracfr* 
^' *"tt«*d hy %U auchoritie,. of ,11 fce «*« he or 
Ac acpectt the «ramw«, to efacusw If the author has 
dane ». * m ^ chat he or ah* « 

Attopghly familiar with rftr epwrion ^ rf^ 
when ic cnTnea aait to do the grading. 

However, jf the author of *e cjuesaon u aot ^ 
person crrhr. only psian who iwU be doing Acgr^ing. 
«*nething mast he done to j, ^ 

have «nm^ chenuelw. in ,fe H u„rion. 

*• « and the* to«»dy 

it before begjnruftg the grading. 

A better way, albeit one chat eeauacs Dure wadt « 
to iend =he grader, the enu^on they *rc going to be 

^^p.n.-rdl.ychewhort^j, .^re^trethem 
» induct independent exarch and wr* their own 
«wer* to the qtuarioii. 

The grader* should archaic che* independent 
aaalv.* and confe toong themselves Co reconcile the 
•nowbk di«W« thae whenevcr rVo Qr ^ 
Uwyer, opEnc on the ,*r. c poWrm. Their diaspora 
d»dd mat in wh« « afi^ ^ , -^^^ 

n=«' aqtwecf wi'O be graded. 
FxmHiMrizatiaa Papers 

Before the a«wal grading begin,, the g^der* .hould 
tends Dutsiber of uwweca (perhaps five or Ten) drawn u 
tandom. not » ^ ^ «, them bia ,„« lo w ^ 
^ "» q^non. 7W ^ Cr 

roay " DI °" r <° be ^preventative of die w of the 
PW l.« theywdi gi«e chegradea* , tod 7eood ideaof 
■^thcr dwre arc isau „ i0w Q p ^ ^ 

■n^ed whether there are L^ea they haTepiekedup that 
* C ""*" ^^gwd^dd^and whether there are 
amb^oea that the author and the graJ™ failed 

» discern- 



,1 4^ 



If the graders percavc any *uch saurzaliu in the 
COUnt aflei4ia g *■ Wiamation pape, they wiB 

for than. For«Hmplc. if it mms « that no* appbeonts 
««»^ a pnint that che author thought v„ cWy 
w«d in the o^ewion, it might be that ic £, „ or, 
^Ataud^rintcr^edln^^^^^^ 
*ddeth» tlC$ ho«Idbc oicountedia thegtodi ag orthat 
»r sJ«ruId be treated purely a.an'c^ credit' is^ for 
rfu appJtamts who .W, lc without deduct. ag cre4t 
6«a the awwer, of thoae who do not SiuiJirJy. if a 
f*^autd lcw d^rdidnot.nt<^nmu U pr CJ LJa^u, 
** *»wm. the graders need to deode wheth, r it is a 
point and w|«he, ro gjye credit /be it. 
Inii is not to »ay that the tail should wag the dog, 
bnt rr i, axcwry & to u ^ ^ 

po^hflity what the a«d W bought w» un« nb,*,- 
««1 7 ^ U in r^Jity «„ „. Ic fc ^ , ^ 

whether co discoonr or ctedi a latent i aaur * ^ 

g«Ji»g procr*. bu. if fiOrne,* «d ecuw^tency „ . IO U 

over the grading c****^ ^ ^ 

Jm ro be ^ the dec^or, made ear y ^ 

^^^^^^•n^^Waxia^n 
pap« « tha, it mak« ic poasihie «> diaeov^ 5l ,eh 

before the grading begin, and co adjm, 
gnding wdard, „ ^ ^ ^ UOuk , 

Gwling Guideiiae* 

^^po^wUxeprocr^.Vuneceaaaryrodeu-de 
howtm^tWauvewdghtrogiveeaAafthe^i,, ^ 
«J»«c, 0 fl. IrrespceaVe of whkh a^tr S are being 
oaaaabsoh^^^^^^^^^^ 
on a tclanwe scale ^answer a is boxer than answer i),a U 
** iraWC * CQmm * » ***** f« guidance of t ie 

gr*fc« a ^crip^ afm ucetpnbJe anww# in^, g 
d* charaetexistic. chat sepaa^ a ^ ^ ^ aB 

eRtid " 1 m 8^«er credi,. For eaampfc. rf" 
H*pera are being scored nn a appoint teak ^ , ^ ; 
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of four is considered a "bare piss." whac muse an answer 
contain in order to achieve a score of four and what 
o^rartguisher « from the fives and sixes; 

II is, of course, powbtc to make do with the anchor's 
analysis pr die graders* consensu* analysis and to annorare 
it appropriately to ccmind chr gzader* of the relative 
weL^cs and the anomalies and how m u eai diem. A better 
approach, however, is to prepare a scpaiacc grading guide- 
line that sees forth the issues, die agreed-upon wights 
assigned o> each tegraent of the answer; directs ons to the 
grader* on how to rrear die expectable pexmutsti o ns, and 
what constitutes "passing" or btctcr on each of the issue*. 

The gradingguiddine needn't be eJaboraxc. On pagrs 
$$-34 u a sample of a cne dw was used in an M&X grading 
workshop foibwoig the July 1995 Multistats Essay Ex- 
arninatiOTL The essay question that underlies it appears 
at rigfrr. In die two- column form, the gwdrline breaks 
die cju*&rion down into three ma jet issues and. uadec each 
of the major headings it sets forth ia the left-hand 
column the sub-points that cxarainn-s would be expected 
to cover in discussing the issue described »n die heading. 

In keeping with die holistic approach, the guideline 
stares in die ngtu-hand column the gross weight-assigned 
to the major issues- Ic drafts nor allocate (he grot* weights 
further as among the aub-pornts under cadi heading. It 
U Ufx to the grader, for example, to decide how much of 
the 40% assigned to the ftrsc major issue each examinee 
should receive. 

Also in the right-hand column, the guideEce con- 
wrins comments regarding such things as whac ecetsmurea 
a "bare pass/' whaL distinguishes hercer answers end how 
expectable examinee responses shuuld be treated For 
example, the chizd call of the cosay question at right 
directs ihr r*»rainres to discuss the rzghes of a party under 

UCC, En several of die famJiaxgarion papers, ir was 
noticed that the ecatmnee* were discussing common law 
contracts and n>ro? principles. It was determined among 



Question 2 

Acme needed money to finance To manufetf uring 
operations. Brenda agreed to I era Acme *lu 3.000 
7 Acme would grant Brenda a security Inter at in 
Acme's primary production machine. At mat tJroe, 
(he machine was unencumbered by any other secu- 
rity interests. Afer agreeing to Breftjda's turns. 
Acme dttftvttxd to Brenda a property executed 
$100000 negoxiabfo now pa/able to the orrjer of 
Brenda. Immediaieiy upon disbursing the loan iindi 
to Acme, Brenda filed a proper*/' executed fina icing 
statement in the appropriate UCC pubBc flung < fllce. 
ShB neglected, however, to obtain a written se< urtty 
agreement from Aer|!e» 

Two months rater, through no feutt of Brei da*s» 
Cathy stole the Acme note from Bcenda's safe* 
forged Brenda's signature on the back of the tote, 
and sow the note to Dan, who took the instm nent 
for value. In good faith, and without notice o F the 
matt Brenda learned that Dan now held the me. 
Brenaa atso heard that lasx week Acme had bor- 
rowed $50,000 from Edward and that Edward ateo 
had taken a security Interact in Acme's priinary 
production machine. 

After hearing about Edward's loan and secqrtt t in- 
terert. Brenda realized that she had never obtained 
a signed security agreement from Acme granting her 
an interest In the machine. Upon c&covenng this 
oversight Brenda gec Acme oo sign such an *| ree- 
menr. By xfcen, however, Edward had already let ned 
the $50.000 co Acme, had received Acme's signs ure 
on a security agreement; and had property W id a 
financing scatement covering Acme** machine. 

I . Does Brenda's security interest in Acme's |ma- 
chine cake priority orer Edward's Interest? Ex- 
pWft. 

2- As between Dan and Brenda, who has superior 
rights to the noxe? Explain, 

3. rf Brenda's r%Ms are superior to Pan's, on * hat 
theories, if any, under the UCC may Dan] re- 
coyer against Cathy? Exp kin- 
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DRAPING GUIDELINES 



I!. 



ISSUES 



PRIORITY AS BETWBN THE SECURITY 
JNTERBT5 OF &RENDA AND EDWARD 

- Under Article 9 of die UCC when there ts a 
priority <itpute retaorifc to security Inters** 
the party wtio first filed or perfected gains 
priority. 

■ Perfection requires boch ooochmenf of the 
lectfrity interest end filing of nortec In the 
appropriate government office. 



* BrvrtdVs feffure ro obtain a signed *ecuii ty 
agreement prevented eeoehroem and, 
therefore, there waa no perfection, 

■ Edward's interest was perfected before 
Bnanoe's. 

■ However, Brenda flted before Edward 

* Since Sranda perfected bf obtain m£ a 
security agreement, her cecurlo/ (nearest 
date* bacfc m die nme of fiAng, 

* Since she filed before Edward perfected or 
filed, Brend*. prevails. 

RIGHTS TO THE NOTE AS BETWEEN 
PAN AND BRENDA 

■ The face* maJce it appear chst Dan a 
holder In dua course — le, char 



• He give value: 

■ Took m good fehft; 

• And without notice of forgery. 



COMMENTS 



40* WEIGHT 



Applicants who note These requirements on 
achieve a "passing' score. Sector grades wifi go 
to appficeno who. In addtcfon. dbeuii ifte 
components of attachment — i.e, (I ) die 
creditor gave value, (2) the debtor had rtghes m 
the coUraraf, and, (3) debtor **ned a security 
agreement 



40* WEIGHT 



We expect bemr papers to explain why Den 
vvai not an HDC, bvt applicants who go dJroctfy 
co the "holder" is$u« and explain why Dan was 
not a "holder" can achieve a ••dear pass." 



3J 
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GRADING GUIDELINES 




ISSUES 


COMMENTS 




• One component of being an HDC r however, 
is chare *c person must, jn the first instance* 
bo a ■'holder," 

■ Slice the nose was. mads to the order 
of Brenda, her indorsement was a 
necessary component to proper 
negotiation. 

■ Whhout Brent's Indorsement; Dan 
could not bo a "hotde?*' and, therefore, 
could not be en HOC 

• QaiT* rights are therefore subject to pVenoVs 
ownership rfthrs- 

111. DAN'S THEORIES OF RECOVERY 
AGAINST CATHY 

■ A* transferor of the not*. Cathy is heti to * 
number of transfer warranties, at (oast 3 of 
which she breached: 

■ Thai she was a person emitted to 
enforce the note: 

■ Thai ail signatures were authentic or 
authorized; 

■ That no defense of any party to die 
note ii good against her. 

■ The forgery vitiates *H three warranties end 
g>ves Dan the right to recover the value paid 


/ 

■ Applicants who rnlss the "holder'" issvj* and. 
instead, go off on a "real defense" analysis [i.s 
that forgery is a "real defense") should necdv 
some credK for reaching the correct result, b 
cannot get tufi credit. The call asks who has 
stB?er1or rights to the note, not whether Brer* 
has a defense against enforcement of the note 

20% WEIGHT 

■ The call specifically asks for Dan's rights und& 
die UCJC Thus, discussions about contract an 
tort (e£~ fraud) theories are not entitled to 
credit. 

• We expect applicants to discuss the transfer 
warranties separately. Those who merer/ nou 
Cathy breached transfer warranties and da nc 
expand on the discussion may achieve a "bare 

understand the law. 


9 

\ 

it 
fa 

1 

i 

1; 


t 1 .1; 
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Ac graders tha: such discussions would not be given 
credit becwe tfwy were not responsive rn the aQ cf die 
question, and the guideline, 1© rhe comment* column, was 
annotated so icfclccc this decision. 

This kind of grading guideline is ato invaluable 
when a relative scoring systtm is in place. In order to 
dewimine whether one answer is better than anodw, 
graders We co begin by agreeing oti whar they would 
eapect W a "good answer.'* He desodpdon of* "bare 
pay*" on an absolute scale 1* .simply translated ro "aver- 
age" or "ji»c above average" on a icJarive reafc, depending 
00 how well applicants in general axe doing in response 
to rhe question. 

Calibration 

Successful onpicnieatattoa of a holistic jading pro- 
local requires mining the graders to apply the same 
standards afl answers. The term commonly used 
po describe this tnunuig „ *cah1>ttuion.'' If oaly 

one person zs grading all ihe answers to a particular essay 
ouesrion, there w F of course, no need to coordinate 
grading standards wwh anyone else However, it is still 
caiporiant rhac the single reader go through the step* of 
writing an analysis, reading a random sample of answers 
adjusting the analysis ro account ior anomalies, and 
identifying answers that are examples w f each point Oil 
chc grading scale, somco'mw called "anchor papers" or 
"benchmark answers.'' Once regular grading is in pro- 
grtw, the reader should refer en the anchor papers pen- 
«£c=iHym order m a cottsiatorgradir^etarJoW, 6 

When mote than one grader is assigned ro the 
Question, ir is essential ro iroure a* much as possible 
oonsisrency among die grader* Thi* is eapeciauy «o as chr 
number of graders grows beyond two, because the oppor- 
tunity for scoring discrepancies expands e^rponentndly. 

CaliVurion can be as simple a process as having d* 
graders meet u» review and assign scores to a number of 



answers before beginning the final grading, - n the cou^e 
of che meeting, the cask fox the graders wowl i be to agree 
to the grading standards and develop the gn ding guide- 
line*. This wotju reasonably well if che nunbi x of grader* 
per question is small. 

When more than two graders are scotx lg essay or 
pesrounancc test answer* adequate caKbrooon will be 



achieved if procedures bice the ones rhat 
employed before the final grading begins 



oliow are 



IninaX Meeting — First Phase 
Afer having iradependendy researched aiu written a 
narrarive analysis to the question, havmg zcvu wed each 
odier' s written analyses and having read <ome 
aarion papers, the graders meet to c^nstrucca <onsensus 
analysis and develop fiwgrado^gnideIme.Typi ;a% dus 
part of die znc rang rakes half a day a* d proceeds rhis way, 
Thr*uperv*ii,g grader — who might beam anber of 
the board of bar examiner* or someone such as a senior 
g*wk* — will havr prepared a rough draft of a gradmg 
guideline based on the author's analysis and the wmrrn 
analyses s iihmicted by die graders- Iht firs: ceder of 
business is to discuss the differences in die rraders' 
analyse* and go over die grading guideline point b r point, 
modifying ir to take into account the vVws espre tsed by 
the graders as rhe drsc assion progresses. The gro t p will 
agree to the ^ataqve weights co be assigned to -l * major 
issues and will define what points are ee<jiifc<l in a 
minimal acceptable answer. Their agreement w mains 
subject, to further modification as they proceed m ;ough 
the next step rf grading actual answers. 

Once a geneeal consensus has btzn reached on 1 what 
js in the rrnestion and wJiar is expecttd of the exam nees, 
phorocopin of identical sets uf aboup j 5 ans*/ers d rawn 
at random from she examinee pool are distributed d > rhe 
graders. They read ihe first answer s£lendy and asu jp if 
a score. The supervising grader rallies dtr scores, a >d a 
discussion ensues, wfrh the graders esr^aining why hey 
A Moan, fob, GaApt pig Bas, Gxamzh^itcn £ssa> Quarrtow 55 
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gave tHac paper the scores they did- The ducussion goes 
on UnrU die group reaches a consensus, based on the 
rr pTi nV grading guideline, as to what is the correct scm* 
for dwr paper. Then rhey read the next answer in the 
batch, ditcus* ic. reach a consensus, and so forth, until 
they have read and discussed all the photocopied answers 
and have idenufced benchmark ansmS*. 

When q relative scoring system 15 employed, graders 
begin by reading two ox three answers arid rank-csdesing 
than- The graders then reach consensus on which of the 
answers was the belter or besc of the group, and diey 
assign tentative scores of "average,"' *~ sup trior/' and so 
Ibrth- They dven read another pair of answer* and deter- 
mine whether ihey were better or worse dun the first 
group graded- Scores on die sample papers are adjusted 
until answers that see samples of each of rhe palms on 
che grading scale arc identified,- chese samples serve as 
"anchor papers" for actual grading. 

Initially at lease, cheie i> almost always divergence 
among die secies assigned by the several gnwrs. As the 
group works its way through the batch of papers, the 
divergence narrow*, and U becomes easier co identify die 
points upon which the grade* differ. As chose po«*cs 
become apparent, die grader* decide how to resolve rhcrn, 
arid they make the necessary modification* co the grading 
guideline. 

Almost miraculously, chert: cosies a point in chs 
process when rhe grading dirrerences begiu to disappear 
and, except for (he occasional maverick, die scores of the 
several graders on die same paper converge* At die end of 
this group grading session, she final version of the grading 
guideline is agreed to. and it becomes the standard apinse 
which all answers are there afar scored. 

Initial Meeting — Second Phflac 

la aider to test the c&cacy cif the calibrarian rhac h*s 

gone on so far, rhe graders ate given photocopes of 

identical «ers of anodier 10 to a© answers and ale directed 

jb Thp Bar hxAMnozii f eM**s>T 1996 
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co read and score them independently. They record dieir 
grades on a score sheet and tucn rheru co ihs wpervjsixig 
grader. This process takes up the rest of the fosc da/ of 
caliraliun. Within the next few days, thf supervisor 
compiles a rnaxdx ftom the graders' score sheets and 
idcnrirus any papers on *»hich the scores difi rred widely 
enough to be of concern* 

Next Meeting 

Aboux a week later, che graders reconvet e for about 
half a day, and the first order of business- is to discus the 
supervising grodcr's^jiwnjc and the papers th it he or she 
(dennfied as having 1 rratcepcable score cUSerei ices- Those 
paper* are read and discussed again to figure < ul why die 
scores differed and to reconcile the d^erenc s. Ay no*, 
the supervising grader has prepared and dist ibuted the 
grading guideline in final form (see die samp e on pages 
55-34) and. unless a problem arisrf. rhe guidet W remains 
unchanged throughout the grading process 

Once again, photocopies of idenacal sets of to or so 
randomly drawn papers are distributed to t le gradets, 
and deprocedure rhatwa* followed during tb first phase 
of the initial meeting— -of t eadfflg. scaring, *J id discuss- 
ing them one at a time— u repeated. By now, significant 
score dirfaenoea on any given paper are k * and far 
between, and the graders arc i*ady ro begin * rual grad- 
ing- 



Fou-ow-up CaUBEATXON 

In jurisdictions where rhe span of ww 

beginning of final grading eo completion is 

should be reviewed as they gre rumed m co 

grader is 'drifting** away from the norm; i-e- 

*aenv* that are eouslscendy higher or lower 

being assigned by other graders of the same 

in the case of relative grading, railing to follow 

for the T^rornragc of scores disc should fall 



I "i 



jVott. the 
scores 
tee if *ny 

nSan chose 
% or, 
guidelines 
into each 
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caccgory 7 If a problem irises, the supervising grader 
coranru&fcart* with ihac grader and brings him back into 
line- 

A follow-up calibration meeting of all the graders 
should be achrriulrd about: half way chroogh the grading 
period. Ac the follow-up meeting, the procedure of read- 
ing, scoring, and discussing * Few randomly ael±cted 
papers i* repeated to ensure that the graders have re- 
mained cdibrwd. 



CONCLUSION 

There is nothing magic or ngid abouc che procediare 
drembed above. It can be modified or truncated in any 
number of ways to suit xhe fictds of the examining 
jurisdicriau. For example, ccn to fifteen graders from 
jurisdictions rrtar use the N Cfi F*F MnlristaTf Rway Ex- 
anwawm usually acxxid each MEE grading woxtcshop 
z*ssioB, the goal of which U go familiarize graders with 
the range of answers rhcy act likely ro encounter. A 
random sample; of three or move answers from each of 
the represented 5taw— a rocal of abour 30 answers— c* 
available for review. The workshop farilitator reads the 
answers chc day before the workshop and determines 
which will be tued to demonstrate die variety of answers 
graders might andctpaor and which opca demonstr^ 
particular grading problems. The graders need nor be 
calibrated in the sense of agreeing on the difference 
between an answer that is a "bar* pa*a" and one chat is a 
"bare fad," because each will return to grade papers in hi* 
or her jurisdiction, applying *car* rtandaids to the proc- 
ess. However, gta4en leare the senior, in general agree- 
ment about how to rank order the papers chcy have read 
and having agreed on what constitute* a "good aa*wei" 
to the question. 

The procedure* described above lend themselves 
»cU to holistic grading and prescribe that can be 
used to ensure rhar essay examination grader* prepare 



themselves fully so that they can grade fith fairness, 
consistency, and ohjecoviry. 



Endnotes 

i. See Kbtn, "*Opnon> fur Assigning Essay S=or this issue. 

p. »+; LmA. ~Gnamg dw Ess^y Examift* Son," ZZr Bar 

Extmavr* Avgy*t 1990. p. 16. 
*» The Memam-WcbsEer Coifcgiatte Diedonaty, lakh Ed. sfefinec 

hohstic as> 'rdatmg v? ur conormcd with. wKoks or wiJi 

couiplccr &jrtcras rather than virh the analyst of, 

a£ or dlueccion inro pates." 

3. Wein, 11 ar 24; Lend. Za\ at 17 

4. Leoelifct 

5 One of fhe fiul-sJe m±9*wta t**d in &b psepa ration of cKe 
NCBffs Mufrfcrart Essay Etnmituaan u e> c induo; a pre- 
test of die quwaanc before ehey art finally selected for 
mc iu ai' oo on an armat ewnnuaor. form, IUw nr successful 
bar applicants m asfesd co answer the cji*idon> unrtrc 
p»uwa»on condioo.-u, and chtir answers arcfLoolccd 
acc if aajr anomalies appear. OcroonaH^ pck 
; <juc£cion is mod i /ind or die analysis id annotate I 
grades co nuke certain *Kt7vraoccf In light of 1 tc anuiuU^ 

«. LmcLZ&at2a. 

> For example, a *raw mighx uee a ftvea-poiar buJ trhcre chc 
aeore of io« represent* * psprr chat ip avnagi , and wberc 
graders have been iarotKtcxico auigq bb mOsc ci on 10% nor 



less chan 10% of ihrir 



to any of ibc 



On afivc-poira; scale, graders ought be loscructe I w a*:n for 
au% at each cf the poma of rhc jdle, w£rh tu xnoxc 
50% noc lav dun 10% at any poiai. 
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